A Reevaluation of Assessment Center Construct-Related Validity
نویسندگان
چکیده
Recent Monte Carlo research (Lance, Woehr, & Meade, 2007) has questioned the primary analytical tool used to assess the construct-related validity of assessment center post-exercise dimension ratings (PEDRs) – a confirmatory factor analysis of a multitrait-multimethod (MTMM) matrix. By utilizing a hybrid of Monte Carlo data generation and univariate generalizability theory, we examined three primary sources of variance (i.e., persons, dimensions, and exercises) and their interactions in 23 previously published assessment center MTMM matrices. Overall, the person, dimension, and person by dimension effects accounted for a combined 34.06% of variance in assessment center PEDRs (16.83%, 4.02%, and 13.21%, respectively). However, the largest single effect came from the person by exercise interaction (21.83%). Implications and suggestions for future assessment center research and design are discussed.
منابع مشابه
Investigation of the Construct Validity of Assessment and Development Center for Managers: Case Study of National Iranian Oil Company (NIOC)
The purpose of this study was to examine the construct validity of the Assessment and Development Center for Managers of NIOC. The method of research was applied and the data collection was descriptive – analytical. The statistical sample included which have been selected by simple random sampling (Cochranchr('39')s sample size formula) 1022 managers from the competent managers’ database of the...
متن کاملEXERCISE SIMILARITY AND ASSESSMENT CENTER VALIDITY 1 Are Improvements in Assessment Center Construct-Related Validity Paralleled by Improvements in Criterion-Related Validity? The Effects of Exercise Similarity on Assessment Center Validity
Previous studies have found that factors that improved assessment center (AC) constructrelated validity also had beneficial effects on criterion-related validity. However, some factors might have diverging effects on constructand criterion-related validity. Accordingly, we followed recent calls to evaluate constructand criterion-related validity of ACs simultaneously by examining the effects of...
متن کاملEvaluation of the Validity and Reliability of a Communicative Scale for Translation Quality Assessment
The present study assessed the construct validity and reliability of a researcher-constructed psycho-motor mechanism scale based on the communicative theory of translation proposed by PACTE (2003). In doing so, the necessary criteria for designing the scale were obtained by a thorough review of related literature on previously constructed scales in error analysis or holistic ones. Moreover, in ...
متن کاملA new frame for frame-of-reference training: enhancing the construct validity of assessment centers.
The authors undertook a comprehensive examination of the construct validity of an assessment center in this study by (a) gathering many different types of evidence to evaluate the strength of the inference between predictor measures and constructs (e.g., reliability, accuracy, convergent and discriminant relationships), (b) introducing a theoretically relevant intervention (frame-of-reference [...
متن کاملEvaluation of the Validity and Reliability of a Communicative Scale for Translation Quality Assessment
The present study assessed the construct validity and reliability of a researcher-constructed psycho-motor mechanism scale based on the communicative theory of translation proposed by PACTE (2003). In doing so, the necessary criteria for designing the scale were obtained by a thorough review of related literature on previously constructed scales in error analysis or holistic ones. Moreover, in ...
متن کامل